Methods for living guidelines: early guidance based on practical experience. Paper 2: consumer engagement in living guidelines.

OBJECTIVES: To describe and reflect on the consumer engagement approaches used in five living guidelines from the perspectives of consumers (i.e., patients, carers, the public, and their representatives) and guideline developers. STUDY DESIGN AND SETTING: In a descriptive report, we used a template to capture engagement approaches and the experiences of consumers and guideline developers in living guidelines in Australia and the United Kingdom. Responses were summarized using descriptive synthesis. RESULTS: One guideline used a Consumer Panel, three included two to three consumers in the guideline development group, and one did both. Much of our experience was common to all guidelines (e.g., consumers felt welcomed but that their role initially lacked clarity). We identified six challenges and opportunities specific to living guidelines: managing the flow of work; managing engagement in online environments; managing membership of the panel; facilitating more flexibility, variety and depth in engagement; recruiting for specific skills-although these can be built over time; developing living processes to improve; and adapting consumer engagement together. CONCLUSION: Consumer engagement in living guidelines should follow established principles of consumer engagement in guidelines. Conceiving the engagement as living, underpinned by a living process evaluation, allows the approach to be developed with consumers over time.

Methods for living guidelines: early guidance based on practical experience. Paper 5: decisions on methods for evidence synthesis and recommendation development for living guidelines.

OBJECTIVES: Producing living guidelines requires making important decisions about methods for evidence identification, appraisal, and integration to allow the living mode to function. Clarifying what these decisions are and the trade-offs between options is necessary. This article provides living guideline developers with a framework to enable them to choose the most suitable model for their living guideline topic, question, or context. STUDY DESIGN AND SETTING: We developed this guidance through an iterative process informed by interviews, feedback, and a consensus process with an international group of living guideline developers. RESULTS: Several key decisions need to be made both before commencing and throughout the continual process of living guideline development and maintenance. These include deciding what approach is taken to the systematic review process; decisions about methods to be applied for the evidence appraisal process, including the use of unpublished data; and selection of "triggers" to incorporate new studies into living guideline recommendations. In each case, there are multiple options and trade-offs. CONCLUSION: We identify trade-offs and important decisions to be considered throughout the living guideline development process. The most appropriate, and most sustainable, mode of development and updating will be dependent on the choices made in each of these areas.

Methods for living guidelines: early guidance based on practical experience. Paper 4: search methods and approaches for living guidelines.

OBJECTIVES: To describe the key features of a continual evidence surveillance process that can be implemented for living guidelines and to outline the considerations and trade-offs in adopting different approaches. STUDY DESIGN AND SETTING: Members of the Australian Living Evidence Consortium (ALEC), National Institute of Health and Care Excellence (NICE), and the US GRADE Network (USGN) shared their practical experiences of and approaches to establishing surveillance systems for living guidelines. We identified several common components of evidence surveillance and listed the key features and considerations for each component drawn from case studies, highlighting differences with standard guidelines. RESULTS: We developed guidance that covers the initial information needed to support decisions around suitability for living mode and the practical considerations in setting up continual search surveillance systems (search frequency, sources to search, use of automation, reporting the search, ongoing resources, and evaluation). The case studies draw on our experiences with developing guidelines for COVID-19, as well as for other conditions such as stroke and diabetes, and cover a range of practical approaches, including the use of automation. CONCLUSION: This paper highlights different approaches to continual evidence surveillance that can be implemented in living guidelines.

The move towards living systematic reviews and living guidelines in healthcare: consideration of the possibilities and challenges for living qualitative evidence syntheses.

Over the past decade qualitative evidence synthesis (QES), a range of methods for synthesising qualitative research evidence, has become a valued form of evidence for guideline producers who wish to understand more about patient preference and acceptability of treatments. The surge in interest in living systematic reviews and the appearance of living guidelines as a response to the COVID-19 pandemic potentially weaken the value and usability of QES.There are currently no published methods for producing living QES, and if QES are to remain of worth to guideline producers then methods for the rapid, frequent updating of them will need to be developed. We discuss some of the similarities and differences between qualitative and quantitative evidence syntheses and highlight areas where development is needed if reviewers are to progress with living approaches to QES.

Weekly updating of guideline recommendations was feasible: the Australian National COVID-19 clinical evidence Taskforce.

OBJECTIVES: To investigate how quickly evidence was incorporated into the Australian living guidelines for COVID-19 during the first 12 months of the pandemic. STUDY DESIGN AND SETTING: For each study concerning drug therapies included in the guideline from April 3, 2020 to April 1, 2021, we extracted the publication date of the study, and the guideline version the study was included in. We analyzed two subgroups of studies as follows: those published in high impact factor journals and those with 100 or more participants. RESULTS: In the first year, we published 37 major versions of the guidelines, incorporating 129 studies that investigated 48 drug therapies informing 115 recommendations. The median time from first publication of a study to incorporation in the guideline was 27 days (interquartile range [IQR], 16 to 44), ranging from 9 to 234 days. For the 53 studies in the highest impact factor journals, the median was 20 days (IQR 15 to 30), and for the 71 studies with 100 or more participants the median was 22 days (IQR 15 to 36). CONCLUSION: Developing and sustaining living guidelines where evidence is rapidly incorporated is a resource- and time-intensive undertaking; however, this study demonstrates that it is feasible, even over a long period.

Testing guidelines during times of crisis: challenges and limitations of developing rapid and living guidelines.

BACKGROUND: The start of the COVID-19 pandemic presented a situation in which there was an urgent need for decision-making that relates to diagnosis, but the evidence was lacking, of low certainty or constantly changing. Rapid and living guideline development methods were needed and had to be applied to rigorous guideline approaches, such as the Grading of Recommendations Assessment, Development, and Evaluation approach. OBJECTIVES: To describe the process of developing rapid diagnosis guidelines when there is limited and imperfect available data at the time of crisis. SOURCES: Case example from four Infectious Disease Society of America COVID-19 diagnostic guidelines. CONTENT: As the world was experiencing panic with COVID-19, there were serious doubts about the feasibility of following a rigorous process for guideline development when timeliness was of extreme value. The Infectious Disease Society of America guideline panels supported by several methodologists strongly believed that at times of crisis, it is more important than ever to follow a rigorous process. The panel adopted a rapid and living systematic review methodology and applied the Grading of Recommendations Assessment, Development and Evaluation approach to four diagnosis guidelines despite the challenges of scarce and dynamic evidence. We describe the methodological details of the rapid and living approach (data extraction, meta-analysis, Evidence to Decision framework, and recommendation development), the challenge of resources, the challenge of scarce evidence, the challenge of rapidly changing evidence, as well as 'wins' from the Infectious Disease Society of America experience. IMPLICATIONS: Mitigation of pandemics relies on rapid and accurate diagnosis, which is challenged by many knowledge gaps. This necessitates emerging evidence is rapidly incorporated in a living fashion with several decisional and contextual factors to ensure the best public health strategies and care for patients. This process must be systematic and transparent for developing trustworthy guidelines and should be supported by all stakeholders, including researchers, editors, publishers, professional societies, and policymakers.

Methods for living guidelines: early guidance based on practical experience. Paper 3: selecting and prioritizing questions for living guidelines.

OBJECTIVES: This article is part of a series on methods for living guidelines, consolidating practical experiences from developing living guidelines. It focuses on methods for identification, selection, and prioritization of clinical questions for a living approach to guideline development. STUDY DESIGN AND SETTING: Members of the Australian Living Evidence Consortium, the National Institute of Health and Care Excellence and the US Grading of Recommendations, Assessment, Development and Evaluations Network, convened a working group. All members have expertize and practical experience in the development of living guidelines. We collated methods, documents on prioritization from each organization's living guidelines, conducted interviews and held working group discussions. We consolidated these to form best practice principles which were then edited and agreed on by the working group members. RESULTS: We developed best practice principles for (1) identification, (2) selection, and (3) prioritization, of questions for a living approach to guideline development. Several different strategies for undertaking prioritizing questions are explored. CONCLUSION: The article provides guidance for prioritizing questions in living guidelines. Subsequent articles in this series explore consumer involvement, search decisions, and methods decisions that are appropriate for questions with different priority levels.

Report from the CVOT Summit 2021: new cardiovascular, renal, and glycemic outcomes.

The 7th Cardiovascular Outcome Trial (CVOT) Summit on Cardiovascular, Renal, and Glycemic Outcomes, was held virtually on November 18-19, 2021. Pursuing the tradition of the previous summits, this reference congress served as a platform for in-depth discussion and exchange on recently completed CVOTs. This year's focus was placed on the outcomes of EMPEROR-Preserved, FIGARO-DKD, AMPLITUDE-O, SURPASS 1-5, and STEP 1-5. Trial implications for diabetes and obesity management and the impact on new treatment algorithms were highlighted for endocrinologists, diabetologists, cardiologists, nephrologists, and general practitioners. Discussions evolved from outcome trials using SGLT2 inhibitors as therapy for heart failure, to CVOTs with nonsteroidal mineralocorticoid receptor antagonists and GLP-1 receptor agonists. Furthermore, trials for glycemic and overweight/obesity management, challenges in diabetes management in COVID-19, and novel guidelines and treatment strategies were discussed.Trial registration The 8th Cardiovascular Outcome Trial Summit will be held virtually on November 10-11, 2022 ( http://www.cvot.org ).